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Abstract.  In  a  recent  paper,  it  was  shown  in  detml  that  in  the  case  of  orthonormal  and  biorthonormal  filter 
banks  we  can  convolve  two  signals  by  directly  convolving  the  subband  signals  and  combining  the  results.  In 
this  paper,  we  fmrther  generalize  the  result.  We  also  derive  the  statistical  coding  g£dn  for  the  generalized 
subband  convolver.  As  an  application,  we  derive  a  novel  low  sensitivity  structure  for  FIR  filters  from  the 
convolution  theorem.  We  define  and  derive  a  deterministic  coding  gain  of  the  subband  convolver  over  direct 
convolution  for  a  fixed  wordlength  implementation.  This  gain  serves  as  a  figure  of  merit  for  the  low  sensitivity 
structure.  Several  niunerical  examples  are  included  to  demonstrate  the  usefulness  of  these  ideas.  By  using 
the  generalized  polyphase  representation,  we  show  that  the  subband  convolvers,  linear  periodically  time 
varying  systems,  and  digital  block  filtering  can  be  viewed  in  a  unified  manner.  Furthermore,  the  scheme 
called  IFIR  filtering  is  shown  to  be  a  special  case  of  the  convolver. 
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1.  INTRODUCTION 


1.1.  Main  results  of  this  paper  and  previous  work 

Convolution  plays  a  central  role  in  digital  signal  processing.  Many  well-known  algorithms  are  proposed  to 
reduce  the  computational  complexity  of  convolution  [1].  In  this  paper,  our  mm  is  not  to  find  an  algorithm  that 
is  faster  than  existing  fast  algorithms.  Our  goal  is  to  find  a  more  accurate  way  to  compute  the  convolution 
when  the  convolution  is  implemented  with  finite  precision.  For  this  we  use  filter  bank  techniques.  Consider 
the  filter  bank  in  Fig.  1.1(a),  where  Hk{z)  are  the  analysis  filters  and  Fk{z)  are  the  synthesis  filters.  This 
multirate  system  has  been  studied  by  a  number  for  researchers  [2]-[8].  The  analysis  bank  splits  the 

signal  x(n)  into  the  subband  signals  Xk(n). 

In  a  recent  paper  [2],  it  was  shown  that  if  the  systems  in  Fig.  1.1  are  perfect  reconstruction  systems 
(i.  e.  x{n)  =  i(n)  and  g{n  -  i)  —  g(n  -  i)),  we  can  obtain  the  convolution  of  i(n)  and  g{n)  by  simply 
convolving  Xk(n)  and  and  adding  the  results.  No  cnosa-convolution  between  the  subband  signals 

is  involved.  When  the  computation  is  done  with  finite  percision,  it  was  also  shown  in  [2]  how  the  energy 
distribution  in  the  subbands  of  x{n)  and  g{n)  can  be  exploited  t'^  obtmn  a  more  accurate  (compared  to 
direct  convolution)  result.  Optimal  bit  allocation  and  coding  gain  over  the  direct  convolution  were  derived 
for  both  the  cases  of  uniform  and  nonuniform  decimated  systems.  In  this  paper,  we  further  generalize  the 
subband  convolution  theorem  and  show  that  no  cross-convolution  between  the  subband  signals  is  involved  in 
the  generalized  subband  convolution  thciorem.  Then  we  derive  the  codmg  gain  for  this  generalized  subband 
convolver.  We  will  also  show  that  the  coding  gain  for  the  generalized  convolver  is  always  greater  than  that 
derived  in  [2],  provided  that  the  filter  banks  are  orthonormal.  We  will  refer  to  the  convolution  theorem 
derived  in  |2]  as  one-level  filter  bank  (FB)  convolution  theorem  and  the  generalized  theorem  in  this  paper 
as  two-level  FB  convolution  theorem.  The  reason  for  these  names  will  be  made  clear  in  Section  2. 

In  [2],  only  the  quantization  in  the  subbands  of  x{n}  was  considered.  In  this  pa|>er,  we  will  address  the 
case  when  the  subband  signals  of  g{n)  are  quantized.  In  this  case,  we  quantize  the  filter  coefiicients  <7j^'^(n) 
in  the  subbands  based  on  the  input  signal  variance,  and  maudmum  amplitude  of  the  filter.  In  the  process 
of  quantization,  the  filter  coefficients  are  treated  as  deterministic  parameters  instead  of  random  variables 
as  done  in  [9].  Thus  overfiow  of  subband  coefficients  is  completely  avoided.  We  will  derive  the  optimal 
bit  allocation  and  the  deterministic  coding  gaun  formulais.  The  derivation  leads  to  a  novel  low  sensitivity 
structure  for  FIR  filters.  The  new  structure  is  particularly  attractive  when  the  filter  g(n)  is  frequency 
selective  and  has  a  long  impulse  response,  or  it  has  some  speciad  time-frequency  relation,  e.g.  the  matched 
filtering  of  a  chirp  signal  in  radaur  application  [10]. 

In  this  paper,  we  also  explore  the  relationship  between  the  convolver  and  the  digitaJ  block  filtering 
[11],  [12]  and  [13].  We  show  that  both  the  one-level  and  two-level  FB  convolvers  are  generalizations  of  the 
conventionaJ  block  filtering.  The  subband  convolvers  have  both  the  atdvantaiges  of  coding  gmn  and  paradlelism. 
Adaptive  filtering  in  subbands  has  been  introduced  with  the  goals  of  both  reducing  the  computational 


complexity  and  improving  the  convergence  speed  of  the  algorithm.  In  [14],  it  was  observed  that  the  overall 
performance  of  subband  aidaptive  filtering  is  acceptable  though  there  is  some  degradation  in  the  convergence 
performance.  In  the  view  of  generalized  block  filtering,  the  structure  used  in  [14]  can  be  regarded  as  a 
simplified  version  of  the  two-level  FB  convolver  introduced  in  this  paper.  Thus  it  is  possible  to  improve  the 
performance  of  the  subband  adaptive  filter  by  using  the  two-level  FB  convolver. 

In  the  light  of  block  filtering,  we  generalize  the  subband  convolution  technique  to  implement  a  linear 
periodically  time  varying  (LPTV)  filter.  By  using  the  generalized  polyphase  representation,  we  show  that 
interpolated  finite  impulse  response  (IFIR)  filter  [15]  is  a  special  case  of  the  subband  convolver. 

The  filter  bank  techniques  have  been  used  in  [16]  to  implement  FIR  and  IIR  filters.  A  different  subband 
convolution  theorem  which  leads  to  computational  saving  is  derived  in  [16].  The  subband  convolution 
theorem  proposed  is  applied  to  the  digital  pulse  compression  in  radar  application  by  Steffen  in  [10]  and  the 
convolution  using  DFT  filter  bank  is  discussed  in  detail.  The  subband  convolution  theorems  discussed  in 
this  paper  and  in  [2]  differ  from  that  derived  in  [10]  and  [16]  in  the  sense  that  the  convolution  is  ‘perfect’ 
regardless  of  filter  responses  of  the  biorthonormal  filter  bank.  Moreover  it  works  for  the  nonuniform  and 
maximally  decimated  cases. 

1.2.  Outline  of  the  paper 

Our  presentation  will  go  as  follows: 

1.  In  Section  2,  we  will  generalize  the  subband  convolution  theorem.  This  is  the  two-level  FB  convolution 
theorem.  A  pictorial  proof  of  the  theorem  is  provided  in  Section  2.3  to  give  a  clearer  insight  into  what 
is  going  on  in  the  convolution  theorem. 

2.  In  Section  3,  we  consider  the  quantization  of  the  input  signal  x(n).  The  optimal  bit  allocation  and 
coding  gain  for  the  two-level  FB  convolver  are  presented. 

3.  A  low  sensitivity  structure  is  derived  in  Section  4,  first  using  the  one-level  FB  convolver  and  then  the 
two-level  FB  convolver.  The  optimal  bit  allocation  and  deterministic  coding  geiin  formulas  for  both  the 
cases  will  be  derived. 

4.  Severed  numerical  examples  are  included  in  Section  5  to  demonstrate  the  usefulness  of  the  low  sensitivity 
structures.  From  the  examples,  we  will  see  that  the  performance  of  the  two-level  FB  convolver  is  better 
than  that  of  the  one-level  FB  convolver.  The  coding  gain  of  the  convolvers  is  also  shown. 

5.  We  will  discuss  the  relationship  among  conventional  block  filtering,  and  one-level  and  two-level  FB 
convolvers  in  Section  6.1.  In  the  presence  of  quemtizers  in  the  subbands  of  g{n),  we  will  show  in  Section 
6  that  the  linear  time  invariant  (LTI)  filter  is  effectively  replaced  by  a  LPTV  filter  in  the  low  sensitivity 
implementation.  We  will  analyze  the  effect  of  this. 

6.  In  Section  7,  we  will  consider  the  application  of  the  subband  convolution  theorem  to  infinite  impulse 
response  (HR)  filters. 
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7.  In  the  last  section,  we  will  relate  the  IFIR  filter  to  the  subband  convolver. 

1.3.  Notations  and  preliminaries 

Notations:  Capital  boldfaced  letters  and  lowercase  boldfaced  letters  are  used  to  denote  matrices  and 
vectors  respectively.  The  {k,  i)th  element  of  a  matrix  E  is  denoted  by  [E]fci.  The  superscript  *  denotes 
complex  conjugate  and  f  denotes  conjugate  followed  by  tranposition.  The  z-transform  of  v(n)  is  represented 
by  V(z).  The  notations  (1^(2))  and  denote  the  M-fold  decimated  and  Af-fold  expanded  versions 

of  the  signal  v(n)  respectively.  The  convolution  of  x(n)  and  g(n)  is  denoted  by  x(n)  ♦  g(n). 

Quantizers:  Consider  Fig.  1.1(a),  where  a  general  Af -channel  nonuniform  decimated  filter  bank  is 
shown.  The  boxes  labelled  Qf  are  the  quantizers.  By  b  bit  quantizer,  we  mean  that  the  output  signal  of  the 
quantizer  is  represented  by  b  bits  plus  a  sign  bit.  In  this  paper,  the  weight  on  the  most  significant  bit  is 
fixed  for  a  fixed  quantizer. 

The  decimators  and  expanders  [17]:  The  boxes  with  j.  njt  denote  the  Uk-fold  decimators  and  the 
boxes  with  |  denote  the  n^t-fold  expanders.  Their  operations  can  be  mathematically  described  respectively 
by  the  following  two  equations: 

where  =  c~^**/"* .  The  subscript  n/t  on  W  will  be  omitted  whenever  it  is  clear  in  the  discussion. 

Maximal  decimation:  An  M-channel  nonuniform  multirate  system  is  said  to  be  maximally  decimated 
if  ^  Ju  ~  1'  1“  *1*®  where  all  n*  are  equal,  this  translates  to  rifc  =  M  for  all  k. 

Conventional  polyphase  representations  [3],  [16],  [17]:  Consider  s  set  of  filters  k  = 

0,  1,  ...  M  —  1.  They  can  be  imiquely  written  in  terms  of  their  M  polyphase  components  as  Hk{z)  = 
z“‘JS*j(z*^).  This  is  known  as  Type  1  polyphase  representation  and  Eki{z)  is  called  the  I-th  polyphase 
component  of  Hkiz).  The  M  x  M  matrix  E(z),  with  its  k-th  row  l-th  column  element  [E(z)]itj  =  Eki{z),  is 
called  the  Type  1  polyphase  matrix  of  the  filters  Hkiz)-  Similarly,  Hkiz)  can  be  written  in  terms  of  their 
Type  2  polyphase  components  as  Hkiz)  =  *  ^Rikiz^)-  The  Type  2  polyphase  matrix  R(z)  of  the 

filters  Hkiz)  is  defined  as  [R(z)]{k  =  Rikiz)-  These  polyphase  representations  are  proved  to  be  valuable  in 
both  the  theory  and  design  of  filter  banks. 

Generalized  polyphase  representations  [6],  [19]:  Generalized  polyphase  (GPP)  was  introduced  in 
[6]  and  used  in  [19]  to  enchance  the  coding  gmn  of  subband  coding.  Instead  of  expressing  a  signal  v(n)  in 
terms  of  the  functions  {z~*}  as  in  the  conventional  polyphase  representation,  we  express  v(n)  in  terms  of 
the  functions  {f/j(z)}  as  follows: 

M-l 

Viz)  =  x;  Viiz^)Uiiz).  (1.2) 

«=0 

This  representation  is  said  to  be  a  valid  GPP  representation  if  the  functions  {t/i(z)}  (called  a  “polyphase 
basis”)  satisfy  the  conditions  [19]:  (i)  Every  rational  function  V(z)  cim  be  expressed  as  (1.2),  where  Vj(z) 
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are  rational,  (ii)  V{z)  is  FIR  if  and  only  if  Vi(z)  are  FIR.  By  defining  U(z)  to  be  the  conventional  polyphase 
matrix  of  the  polyphase  basis  {£/t(2)}i  these  conditions  were  proved  to  be  equivalent  to  det[U(z)]  =  cz*", 
for  c  7^  0  and  integer  k.  We  will  caU  Vi(z)  the  tth  GPP  component  of  the  signal  v{n)  with  respect  to  the 
polyphase  basis  {[7i(z)}. 

Orthonormality  and  biorthonormality  [2],  [3],  [8],  [20]:  From  Fig.  1.1(a)  (ignore  the  quantizers  in 
the  subbands),  the  z-transform  of  the  output  of  the  filter  bank  is 

M-l 

Xiz)  =  X*(z'“)Ffc(z).  (1.3) 

fc=:0 

If  x(n)  =  z(n)  for  all  x(n),  then  the  system  is  called  a  biorthonormal  or  perfect  reconstruction  filter  bank. 
The  biorthonormality  of  the  filter  bank  translates  to  the  following  condition  on  the  filters  Hk{z)  and  Ffc(z): 

[/ffc(z)F„(z)]  ^  -  m),  (1.4) 

where  nk,m  =  gcd(nfc,nm).  From  (1.4),  we  can  see  that  the  perfect  reconstruction  property  is  preserved 
when  we  interchange  the  roles  of  Hk{z)  and  Fk{z).  The  set  of  filters  {F*(z)}  is  said  to  be  orthonormal  if 
(Ffc(z)F,J^(l/z*))^^^  =  6{k  —  m).  In  the  case  of  uniform  decimation  system,  the  filter  bank  is  said  to  be 

paraunitary  if  the  polyphase  matrix  R(z)  of  {Ffc(z)}  satisfies  the  condition  R(z)R^(l/z*)  =  I,  where  I  is 
identity  matrix. 

Remarks:  For  uniform  biorthonormal  system  (all  n*  =  M)  with  FIR  analysis  and  synthesis  filters,  (1.3) 
is  a  GPP  representation  of  X (z)  with  the  polyphase  basis  {l/»(2)}  taken  to  be  {Fi(z)}.  The  subband  signals 
Xk{z)  can  be  regarded  as  the  GPP  components. 

An  Af-chaimel  delay  chain:  Consider  Fig.  1.1(a).  Let  all  nt  =  Af .  Then  the  system  is  a  uniformly 
decimated  system.  If  the  filters  Hk{z)  =  z"*  and  Ffc(z)  =  z*',  then  the  system  is  called  an  M-chaimel 
delay  chain.  Notice  that  a  delay  chain  is  trivially  an  orthonormal  system  with  the  identity  matrix  I  as  the 
polyphase  matrix. 

2.  ONE-  AND  TWO-LEVEL  FILTER-BANK  CONVOLUTION 
THEOREM 

2.1.  Review  of  one-level  FB  convolution  theorem 

Consider  the  two  maximally  decimated  filter  bainks  as  shown  in  Fig.  1.1  (ignore  the  quantizers  in  the 
discussion  of  this  section).  Assume  that  the  system  has  perfect  reconstruction.  Then  it  was  shown  in  [2]  how 
we  can  convolve  two  signals  x(n)  and  g{n)  by  directly  convolving  the  subband  signals  ifc(n)  and  QkH^)  and 
adding  the  results.  No  cross-coupling  between  subbands  is  involved.  More  precisely,  we  have  the  following 
biorthonormal  convolution  theorem: 

Theorem  2.1  [2].  One-level  filter  bank  (FB)  convolver.  Consider  Fig.  1.1.  Assume  that  the  system 
has  perfect  reconstruction.  Define  the  integer  pk  =  L/nk,  where  L  denotes  the  1cm  of  the  decimation  ratios 
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{rifc}.  Let  Xk{n)  and  gl'^(n)  be  the  subband  signals  defined  in  Fig.  1.1(a)  and  (b)  respectively.  Then  the  tth 
polyphase  component,  Vi(n)  of  z(n)  *  g(n)  can  be  written  as 


yi(n)=  ^  (ifcCn)  *  (2.1) 

0 

The  advantage  of  the  subband  convolution  is  that  we  can  compute  the  result  more  accurately  when  the 
convolution  is  implemented  with  finite  precision.  It  was  shown  in  [2]  how  we  can  quantize  the  subband  signals 
Zfc(n),  and  reduce  the  quantization  noise  by  optimally  allocating  the  bits  in  the  subbands.  By  exploiting  the 
subband  energy  distribution,  the  optimal  bit  allocation  scheme  and  the  coding  gain  over  direct  convolution 
were  derived  in  [2]. 

Comments  on  complexity.  Notice  that  the  subband  convolution  theorem  holds  even  when  the 
analysis  and  the  synthesis  filters  are  HR  filters.  But  if  we  consider  computational  cost,  the  FB  convolver  is 
useful  only  when  and  Ffc(z)  are  FIR  filters.  Thus  in  this  paper,  we  will  consider  subband  convolvers 

with  FIR  anal3rsis  and  synthesis  filters  only.  Also  note  that  the  computation  of  Xk(n)  involves  filtering. 
Since  g(n)  is  a  fixed  filter,  the  subband  signals  y|[,*^(n)  can  always  be  precomputed  and  stored.  Thus  the 
complexity  of  the  subband  convolution  is  approximately  equal  to  that  of  direct  convolution  plus  the  cost  of 
implementing  an  analysis  bank,  assuming  that  no  fast  algorithm  for  convolution  is  used.  If  the  complexity 
of  the  filter  bank  is  low  (compared  to  the  length  of  the  sequences  x(n)  and  g[n)),  then  the  computational 
cost  of  Zfc(n)  is  negligible  compared  to  that  of  the  (involution.  In  this  case  the  complexity  of  subband 
convolution  and  that  of  direct  convolution  are  approximately  the  same. 


2.2.  Two-level  FB  convolution  theorem 

Theorem  2.2.  Two-level  FB  convolver.  Consider  Fig.  1.1.  Let  {Hfc(z)}  and  {Ffc(z)}  be  respectively 
the  analysis  and  synthesis  filters  of  an  M-channel  maximally  decimated  nonuniform  filter  bank  with  perfect 
reconstruction.  Define  the  integer  pk  =  L/njt,  where  L  denotes  the  1cm  of  the  decimation  ratios  {nfc}.  Let 
{/ffc(z)}  and  {Fj((z)}  be  respectively  the  analysis  and  s3mthesis  filters  of  a  “L-channel”  uniform  biorthonormal 
system.  Let  Xfc(n)  and  ^(n)  be  respectively  the  fcth  subband  signals  defined  in  Fig.  1.1(a)  and  Fig.  2.1.  Then 
the  ith  GPP  component  yi{n)  of  x{n)*g{n)  with  respect  to  the  polyphase  basis  {I*i(z),  t  =  0,  1,  . . . ,  L- 1} 
can  be  written  as 


M-l 


=  X)  (**(") 


fc=0 


ip* 


(2.2) 


Proof.  FVom  the  definition  of  Xk(z)  and  G^^(z)  and  using  the  biorthonormality  (1.3)  of  the  filters 
{/rfc(z)}  and  {F/t(z)},  we  get 

Af-l  M-l 

X{z)  =  53  Xfc(z"*)F*(z),  and  G{z)H[{z)  =  f?W(z"«)^i(^)-  (2-3) 


il;=0 


1=0 
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Multiplying  the  above  two  equations  and  decimating  both  sides  by  L,  we  have 

[x(z)G{z)m{z)]  _  [F*(z)H,(;^)] 


It 


(2.4) 


fc=0 


where  njt,/  =  gcd(n*,nj)  and  the  integer  p*,/  =  L/rik^.  The  second  equality  follows  from  (1.4)  and  the  fact 
that  [1^(2)]  =  [(^(^))xnj,  )]ip*  i'  A.pplying  the  biorthonormality  of  the  filters  {H[{^z)}  and  {Fi(z)}  the 

left  hand  side  of  (2.4)  is  by  definition  the  *th  GPP  component  of  X (z)G(z)  with  respect  to  the  polyphase 
basis  {F/(z)}.  The  proof  is  complete.  V  VV 

Eqn.  (2.2)  gives  only  the  ith  GPP  component  of  x(n)  *  ff(n).  The  convolution  output  y(n)  can  be 
synthesized  from  the  GPP  components  as  follows: 

Y(z)  =  ^  Fiiz)Yiiz^)  =  2  Ftiz)  Xfc(z'“)Gi‘>(z'“).  (2-5) 

t=0  t=0  fc=0 

Remarks:  Notice  that  for  the  uniform  case,  the  corresponding  formulas  can  be  obtained  by  replacing 
all  Tik  with  M,  and  Pk  with  unity.  Also  notice  that  even  for  the  nonuniform  case,  the  second-level  filter 
banks  with  filters  {Hj^(z)}  and  {F]((z)}  are  constrained  to  be  uniform  filter  banks  with  decimation  ratio 
L  =  lcm{nfc}. 


Comparison  of  two-level  FB  convolver  with  one-level  FB  convolver.  Theorem  2.1.and  2.2  give 
us  respectively  the  implementations  of  one-level  and  two-level  FB  convolver  as  Fig.  2.2(a)  and  (b).  Since  g{n) 
passes  through  two  levels  of  filter  banks,  we  call  the  subbemd  convolver  in  Fig.  2.2(b)  two-level  FB  convolver. 
FVom  these  two  figures,  it  is  clear  that  the  two-level  FB  convolver  is  a  generalization  of  the  one-level  FB 
convolver.  By  taking  ff(.(z)  and  i^(z)  to  be  z“*  and  z*  respectively,  the  two-level  FB  convolver  reduce  to  the 
one-level  FB  convolver.  As  in  the  one-level  FB  convolver  we  see  that  there  is  no  cross-convolution  between 
subbands  in  the  two-level  FB  convolver.  But  in  order  to  obtain  the  convolution  output,  the  outputs  of  the 
subband  convolutions  have  to  be  interpolated  by  the  synthesis  filters  i^(z)  (Fig.  2.2(b)),  instead  of  just 
interlacing  as  in  the  one-level  FB  biorthonormal  convolution  (Fig.  2.2(a)).  The  advantage  of  the  two-level 
FB  convolution  theorem  over  the  one-level  case  will  be  clear  when  we  disctiss  the  low  sensitivity  FIR  filter 
structure  in  Section  4.  The  two-level  FB  convolver  usually  computes  the  convolution  much  more  accurately 
than  the  one-level  FB  convolver,  for  the  same  average  bit  rate.  The  complexity  of  the  former  is  that  of  the 
latter  plus  the  cost  of  an  additional  synthesis  bank  F^{z)  (since  ^^^(n)  can  be  precomputed  and  stored). 
Thus  if  the  complexity  of  the  filter  bank  {F*(z)}  is  low,  then  the  complexity  of  the  new  subband  convolution 
is  comparable  to  that  of  direct  convolution. 


2.3.  Pictorial  proof  of  the  subband  convolution  theorem 

The  above  subband  convolution  theorems  can  be  proved  easily  by  using  a  sequence  of  figmes.  The 
pictorial  proof  of  Theorem  2.1  leads  us  naturedly  to  the  two-level  FB  convolution  theorem.  It  also  gives 
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a  clear  insight  into  what  is  going  on  in  the  subbanc^,  and  why  perfect  convolution  is  perserved  when  we 
pass  from  the  one-level  FB  convolution  theorem  to  the  two-level  FB  convolution  theorem.  By  using  the 
same  technique,  the  subband  convolution  theorem  has  been  generalized  to  the  most  general  case  of  the 
multidimensional  nonuniform  filter  banks  with  rational  decimation  ratios  [21]. 

Consider  Fig.  2.3(a),  where  we  want  to  compute  a:(n)  ♦  g{n).  Clearly,  any  two  identity  systems  Ii  and 
I2  can  be  inserted  before  smd  after  the  filter  G{z)  without  changing  the  convolution  output,  as  shown  in 
Fig.  2.3(b).  If  we  choose  the  identity  systems  to  be  filter  banks  with  perfect  reconstruction,  then  we  can 
utilize  the  frequency  splitting  property  of  the  filter  banks  and  quantize  the  subband  signals  according  to  the 
energy  distribution  in  each  subband.  We  may  also  select  other  identity  systems,  depending  upon  the  task 
we  want  to  perform.  If  we  choose  Ii  to  be  the  perfect  reconstruction  system  shown  in  Fig.  1.1(a),  and  I2  to 
be  an  L-channel  delay  chain,  then  we  can  show  that  the  equivalent  system  shown  in  Fig.  2.3(c)  is  the  same 
as  that  depicted  in  Fig.  2.2(a).  By  using  the  fact  that  L  =  rikpk,  i-  e.  an  L-fold  decimator  is  equivalent 
to  an  Tifc-fold  decimator  followed  by  an  p^-fold  decimator,  the  tth  branch  of  the  system  in  Fig.  2.3(c)  (i.  e., 
the  system  from  x{n)  to  yi(n))  can  be  redrawn  as  Fig.  2.3(d).  Applying  the  identity  in  Fig.  2.3(e),  it  is 
clear  that  the  system  in  Fig.  2.3(d)  is  equivalent  to  the  tth  branch  of  the  system  in  Fig.  2.2(a).  This  is  the 
one-level  FB  biorthonormal  convolution  theorem  that  we  have  described  in  Theorem  2.1. 

Similarly,  to  prove  Theorem  2.2,  we  select  I2  to  be  an  L-channel  biorthonormal  filter  bank  with  perfect 
reconstruction  instead  of  a  trivial  delay  chain.  By  carrying  out  exactly  the  same  procedure  as  above,  we  can 
arrive  at  the  result  proved  in  Theorem  2.2. 

From  the  sequence  of  figures  in  Fig.  2.3,  we  see  how  x{n)  and  p(n)  are  split  into  different  subband 
signals  by  the  two  multirate  systems.  Very  similar  to  the  idea  of  subband  coding,  the  energy  distribution  of 
both  x(n)  and  g{n)  can  be  exploited  to  obtain  a  more  accurate  convolution  if  the  computation  is  done  in 
finite  percision. 

3.  CODING  GAIN  OF  TWO-LEVEL  FB  CONVOLVERS 

In  this  section,  we  will  consider  the  coding  gain  for  the  quantization  of  the  input  signal  x(n)  only.  The 
filter  g{n)  is  not  quantized.  For  the  case  of  one-level  FB  orthonormal  convolver,  the  optimal  bit  allocation 
and  coding  gain  were  discussed  in  detail  in  Section  3.2  and  3.3  of  [2]  respectively  for  both  the  uniform  and 
nonimiform  cases.  For  the  case  of  one-level  FB  biorthonormal  convolver,  as  the  formulas  for  both  the  optimal 
bit  allocation  and  coding  gain  take  exactly  the  same  form  as  (3.16)  and  (3.17)  in  [2]  respectively.  The  only 
difference  is  that  we  cannot  prove  a  result  similar  to  Lemma  3.1  and  3.2  in  [2],  i.  e.,  the  coding  gain  for 
the  biorthonormal  convolver  cannot  be  proved  to  be  always  greater  than  unity.  So  we  will  not  elaborate 
on  the  one-level  FB  convolver.  But  for  the  two-level  FB  convolver,  as  the  subband  convolution  results  are 
interpolated  by  the  synthesis  filters  {Fj((z)}  as  shown  in  Fig.  2.2(b),  the  analysis  of  the  output  error  due 
to  the  quantization  in  the  subband  is  more  complicated.  Furthermore,  the  optimal  bit  allocation  scheme 
is  quite  different  from  that  of  the  one-level  FB  convolver  since  the  energy  of  H[{z)G{z)  is  different  in  each 
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branch  in  Fig.  2.2(b).  We  will  derive  the  optimal  bit  allocation  and  coding  gain  formulas  for  the  two-level  FB 
convolver  in  the  rest  of  this  section.  Since  the  uniform  convolver  is  strictly  a  special  case  of  the  nonuniform 
convolver,  we  will  only  derive  the  result  for  the  nonuniform  case.  The  corresponding  formulas  for  the  uniform 
case  follow  directly  by  replacing  L  and  all  n^’s  with  M. 

Consider  Fig.  2.2(b).  Assume  that  i(n),  ^(n),  and  the  filter  coefficients  in  all  analysis  and  synthesis 
filters  in  the  filter  bank  are  real.  Then  the  quantizer  operates  on  real  inputs  only.  Let  6^^  be  the  number  of 
bits  per  sample  of  Xk(n),  allocated  to  Qki,  the  quantizer  in  the  )k-th  channel  in  the  t-th  branch.  Therefore 
the  average  bit  rate  is 


,  L-l  M-l  , 

‘"tEE-- 


(3.1) 


3.1.  The  noise  model 

The  error  due  to  the  quantizer  Qki  is  defined  as 


9*.(n)=2l‘^(n)  -  Xfc(n), 


(3.2) 


where  z^'^(n)  is  the  quantized  version  of  Xk(n)  in  the  t-th  branch.  The  quantization  error  can  be  modeled  as 
an  additive  noise  source.  Thus  the  quatizer  Qki  can  be  replaced  by  the  broken  line  as  shown  in  Fig.  2.2(b). 
The  reason  why  we  choose  double  index  instead  of  single  index  as  in  [2]  would  be  clear  after  the  derivation 
later. 

To  auialyze  the  convolution  error,  we  make  the  following  assumptions: 

(i)  x(n)  is  zero  mean  wide  sense  stationary  (WSS)  with  variance  ct*.  Then  Xfc(n)  are  also  WSS,  with 
variance 

<  =  S„(e^-)l//*(e^‘")|2^,  (3.3) 

where  5i*(e^")  is  the  power  spectrum  of  i(n). 

(ii)  g{n)  is  a  deterministic  sequence.  We  define  a  useful  parameter  as 

aJ<  =  Mj^|(,l*>(n)|2,  (3.4) 

n 

where  Ci\i(M  can  be  interpreted  as  the  energy  of  the  subbeuid  signal  gk^(n). 

(iii)  gki(n)  is  zero  mean  white  with  variance  where  under  certmn  conditions,  is  related  to  as 


<r 


2 

Vki 


(3.5) 


See  Chapter  4  of  [22]  or  Appendix  C  of  [3].  Here  c  is  a  constant  which  depends  only  on  the  probability 
distribution  of  the  subband  signals  xt(n).  We  have  assumed  that  c  is  independent  of  k  which  is  true 
only  if  all  Xk(n)  have  the  same  probability  distribution. 


9 


The  cross-correlation  of  quin)  is 


P^^kiin)qmi{l)}  =  “  m)S{n  - 1),  (3.6a) 

i.  e.  gfci(n)  is  uncorrelar'- '  to  9mi(0  for  jk  ^  m  and  for  all  i,  n,  1.  Notice  that  E{qki{n)qki{n)}  need 
not  be  zero  for  t  /  j.  We  also  assume  that  qki(n)  is  uncorrelated  to  the  subband  signals  Xk(l),  that  is 

=  0.  (3.66) 


3.2.  Optimal  bit  allocation  and  coding  gain  for  the  two-level  FB  convolver 
To  derive  the  optimal  bit  allocation  and  coding  gain  formulas  for  the  two-level  FB  convolver,  we  assume 
that  the  second  set  of  synthesis  filters  F/(z)  are  orthonormal  (or  equivalently  the  uniform  filter  banks  formed 
by  and  {Fj((z)}  are  paraunitaiy).  Consider  Fig.  2.2(b).  The  error  in  the  subband  convolution 

output  i/i(Ti)  is 


^  (gfci(«)  ♦fi*^(n)) 

fc=0 


iph 


(3.7) 


By  using  (3.4)-(3.6)  and  the  fact  that  the  decimator  will  not  change  the  variance,  the  variance  of  9y,(n)  can 
be  expressed  as 


fc=0  I 

M-l 

=  E  for  0  <  i  <  L  -  1.  (3.8) 

Since  the  synthesis  filters  F[{z)  are  orthonormal,  the  average  variance  over  L  samples,  of  the  output 
error  is  simply  the  average  of  ,  for  0  <  i  <  L  —  1,  see  Section  C.4.2  of  [3]  or  [23].  So  we  have 


L-\ 


L-lM-l 


(3-8) 

»=0  i=0  k=0 

To  obtain  the  optimal  bit  allocation,  we  minimize  the  average  output  noise  variance  under  the  constradnt 
(3.1).  We  form  the  Lagrangian 

1  —  h  \ 

(3.10) 


By  setting  d<f>/dbki  =  0forall0<*<L-l  ,0<Jfc<M  —  1  and  d<f>/dX  =  0,  we  get 

nk2-^‘”‘*(Tl^ali  =  D  for  0<*<i-l,  0<A:<A/-1  (3.11) 

where  D  is  a  constamt  independent  of  i  and  k.  Let  7^  be  the  geometric  meam  of  over  the  index  t,  that  is 


L-l 


72=nK)‘'‘ 


(3.12) 


«=o 


10 


By  using  (3.1),  (3.11)  and  (3.12),  we  find  that 


D  =  2-2»  (3.13) 

kssQ 

Substituting  (3.13)  into  (3.11),  we  find  that  the  optimal  number  of  bits  allocated  to  the  quantizer  Qki  at  the 
A;-th  channel  in  the  i-th  branch  is 

M-l 

bki  =  b  +  0.5  log2  (nktrl^ali)  -  0.5  ^  logj (n^^ 7®) (3.14) 

i=o 


Periodically  time-varying  bit  allocation.  Rrom  (3.14),  we  see  that  the  average  bit  rate  6  must 
be  high  enough  so  that  bki  >  0  for  all  k  and  i.  Notice  that  bki  are  integers  and  the  values  evaluated  by 
(3.14)  must  be  rounded  off  to  integers.  Intuitively,  we  would  assign  more  bits  to  those  quantizers  in  branches 
where  g{n)  *  h'-{n)  has  higher  energy  and  in  chaimeis  where  Xfc(n)  has  higher  energy.  (3.14)  tells  exactly  how 
this  should  be  done  according  to  the  energy  distribution.  In  the  case  of  the  one-level  FB  convolver,  since 
p^*^(7i)  is  simply  obtained  by  time-shifting  ^(n)  (see  Fig.  2.2(a)),  we  would  expect  that  will  have  very 
little  dependency  on  t.  In  this  case,  bki  are  the  same  for  all  i  and  (3.14)  reduces  to  (3.32)  in  [2].  However 
in  the  case  of  the  two-level  FB  convolver,  may  differ  greatly  for  different  i,  especially  when  the  filter 
g{n)  is  a  frequency  selective  filter  (which  is  usually  the  case).  Then  6*,  may  vary  greatly  with  respect  to  t. 
This  is  the  reason  why  we  use  double  index.  In  this  case,  not  all  branches  are  equally  important  as  in  the 
case  of  the  one-level  FB  convolver,  and  the  coding  gain  may  increase  significantly  by  using  this  “periodically 
time-varying”  bit  allocation  scheme. 

By  using  (3.11)  and  (3.13)  and  the  fact  that  the  filter  bank  is  maximally  decimated,  i.  e.  ~ 

we  find  that  the  average  output  noise  vari£Lnce  imder  optimal  bit  allocation  is 


<7 


2 


cD 


•lyopt  Jlf 


l/ni, 


(3.15) 


If  x(n)  is  quantized  to  b  bits,  then  in  the  direct  convolution  the  output  noise  variance  due  the  quantization 
is  found  to  be 

‘^L.ct=c2-“<7*j;i5(01*.  (3.16) 

I 

Under  optimal  bit  allocation,  the  coding  gain  of  the  two-level  FB  convolver  over  the  direct  form  is 

output  varianceldirect  conv 


Gx,  two  — 


output  variance|,ubb«nd  ^ 


E„lp(n)l^ 


(3.17) 


The  “z,  two”  in  the  subscript  in  (3.17)  indicates  that  the  coding  gmn  is  obtedned  by  using  the  two-level  FB 
convolver  and  quantizing  the  signal  i(n).  This  subscript  is  used  to  distinguish  (3.17)  from  the  deterministic 


coding  gain  which  is  obtained  by  quantizing  g{n)  in  the  next  section.  Ftom  the  right  hand  side  of  (3.17), 
we  see  that  the  variation  of  subband  energy  of  both  x(n)  and  g{n)  contributes  to  the  coding  gain.  The  first 
term  is  the  gmn  contributed  by  x(n)  and  the  second  term  is  the  gain  contributed  by  g{n). 

Summary  of  crucial  assumptions.  In  the  derivation  of  (3.17),  we  have  assumed  that  the  constant 
c  in  (3.16)  is  the  same  as  that  in  (3.5)  which  is  true  only  if  x(n)  and  all  Xjb(n)  have  the  same  probability 
distribution.  Also  in  the  above  derivation,  we  have  made  used  of  the  orthonormality  of  the  filters  {F^(2)} 
and  the  uncorrelated  assumptions  of  qki(n)-  Notice  that  only  the  biorthonormality  of  the  filters  {Ffc(z)}  and 
{Hk(z)}  is  required  for  (3.17)  to  be  valid,  orthonormality  of  those  filters  being  not  necessary.  But  without  the 
orthonormality  of  those  filters,  we  cannot  guarantee  that  the  optimal  coding  gain  in  (3.17)  is  always  greater 
than  unity.  If  the  filters  {Fk(z)}  are  orthonormal,  then  we  can  prove  that  the  coding  gain  for  the  two-level 
FB  convolver  is  always  greater  than  unity,  regardless  of  the  quality  of  the  filters  {Hkiz)},  {^*(z)}, 
and  {F;((z)}.  Moreover,  we  can  prove  that  this  coding  gain  is  never  smaller  than  that  of  the  one-level  FB 
convolver  derived  in  Section  3.3  in  [2],  provided  that  x(n),  g(n),  {Hkiz)}  in  both  cases  are  the  same.  More 
precisely,  we  have  the  following  lemma: 

Lemma  3.1.  The  coding  gain  (7x,two  of  the  two-level  orthonormal  FB  convolver  (i.  e.  FB  in  both 
levels  are  orthonormal)  is  never  smaller  than  that  of  the  one-level  orthonormed  FB  convolver,  regardless  of 
the  choice  of  pare  mitary  filters  {^^(z)},  provided  that  x(n),  p(n),  {Hkiz)}  in  both  cases  are  the  same. 
Moreover,  they  are  equal  if  and  only  if  the  sequence  Pfc^(n)  has  the  same  energy  forallO<i<J[/-l.  0 

In  (2],  it  was  shown  that  under  optimal  bit  allocation,  the  coding  gain  of  the  one-level  FB  convolver  is 


Gx.one 


E„b(n)l’ 


l/n*  ' 


(3.18) 


where  a|  is  defined  as 


“fc 


•=0  n 


(3.19) 


where  the  “one”  in  the  subscript  is  used  to  denote  that  9*;’o„e(u)  are  the  subband  filters  of  the  one-level  FB 
convolver  (see  Fig.  3.1).  Comparing  (3.18)  with  (3.17),  we  find  that  the  coding  gain  formulas  for  both  the 
one-level  and  two-level  FB  convolvers  are  very  similar,  except  that  qJ  is  replaced  by  7®.  Therefore  in  the 
following  proof  of  Lemma  3.1,  we  need  to  establish  the  relation  between  a®  and  7®. 

Proof  o/Lemma  3.1.  By  defining  h'(z)  =  [Hoiz)  H[iz)  . . .  J^i,_i(z))^,  and  e(z)  =  [1  z~*  . . . 
we  have  h'(z)  =  E'(z^)e(z),  where  E'(z)  is  the  Z.  x  L  polyphase  matrix  of  h'(z).  FVom  the  definition  of 
pj^*^(n)  and  ^*one(”)>  is  clear  that  p*Hn)  can  be  obtained  by  passing  ^[‘^^(u)  through  E'{z*’*)  as  shown 
in  Fig.  3.1.  Since  E'(z)  is  paraunitary,  we  have  (23] 


H  Iff*  lff*,L(”)P- 


i*0  n 


t=0  n 


(3.20) 
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By  using  (3.4),  (3.19)  and  (3.20),  we  find  the  following  important  equality 


L-t 


1 

a\  =  —  ^  Ofcj  =  arithmetic  mean  of 


(3.21) 


i=0 


By  taking  the  ratio  of  Gx,tvo  to  Gz,onei  we  find  that  the  ratio  of  the  coding  gain  of  the  two-level  FB 
convolver  to  that  of  the  one-level  FB  convolver  is 


i=0 


(3.22) 


Using  (3.12)  and  (3.21)  and  applying  the  AM-GM  inequality,  each  term  in  the  product  in  (3.22)  is 
greater  or  equal  to  unity  with  equality  if  and  only  if  a^,-  =  o*  for  all  t.  So  we  conclude  that  ii*  >  1,  with 
equality  if  and  only  if  =  o*  =  7*  for  all  t.  Or  equivalently,  the  sequences  ^(n)  have  the  same  energy 
for  all  0  <  i  <  L  -  1.  VW 

Corollary  3.1.  Gx.tw  ^  1  for  the  two-level  orthonormal  FB  convolver,  regardless  of  the  choice  of 
the  orthonormal  sets  of  filters  {Hkiz)}  and  {Hj^(z)}.  Equality  holds  if  and  only  if  both 
independent  of  k  and  i.  0 

Prvof.  This  follows  directly  from  the  above  lemma  and  Lemma  3.2  in  [2].  V  W 


4.  LOW  SENSITIVITY  STRUCTURE  FOR  FIR  FILTERS  AND 
DETERMINISTIC  CODING  GAIN 

Ignore  the  quantizers  in  the  subbands  of  i(n)  for  the  discussion  of  this  section.  Very  similar  to  the  idea 
of  quantizing  x(n),  we  can  quantize  the  filter  coefiicients  gk{n)  in  the  subbands  based  on  the  input  signal  vari¬ 
ance  and  maximiun  amplitude  of  the  subband  filter  coefficients.  However,  the  coefficients  have  to  be  treated 
as  deterministic  parameters  so  that  overflow  is  avoided  completely.  In  this  implementation,  the  convolution 
error  due  to  the  coefficient  quantization  is  much  smaller  than  that  in  the  direct  form  implementation.  Let 
gk\n)  be  the  quantized  version  of  g* ^(n).  Then  we  can  redraw  Fig.  2.2(a)  and  (b)  as  Fig.  4.1(a)  and  (b) 
respectively.  The  implementations  in  Fig.  4.1(a)  and  (b)  can  be  regarded  as  low  sensitivity  implementations 
of  the  filter  g{n).  In  this  section,  we  will  discuss  in  detail  first  the  optimal  bit  allocation  and  the  coding 
gain  over  direct  form  for  the  one-level  FB  convolver  and  then  for  the  two-level  FB  convolver.  Again  we  will 
only  derive  the  formulas  for  the  nonuniform  case.  The  corresponding  formtilas  for  the  uniform  case  can  be 
obtained  by  simply  replacing  Uk  and  L  with  M.  For  a  preview  of  the  advantage  of  the  implementaion,  com¬ 
pare  Fig.  5.2  and  Fig.  5.3.  When  the  same  average  number  of  bits  is  used  to  quantize  the  filter  coefficients 
for  direct  convolution  (Fig.  5.2)  and  subband  convolution  (Fig.  5.3),  the  improvement  shown  in  these  figures 
is  significant.  In  the  rest  of  this  section,  we  will  translate  this  improvement  into  a  mathematical  formula. 

4.1.  Low  sensitivity  FIR  filter  structures  using  the  one-level  FB  convolver 

With  the  quantizers  inserted  in  the  subbands  of  g{n)  as  in  Fig.  2.2(a),  let  6*  be  the  number  of  bits  per 


13 


sample  of  gk{^)f  allocated  to  the  quantizers  Then  the  average  bit  rate  b  is  defined  as: 


Af-l  . 


4.1.1  The  noise  model 

Define  the  detenninistic  quantization  error  to  be 

^(n)=Sfc‘^(n)  -  flfc  ^(n),  (4.2) 

where  g^\n)  is  the  quantized  version  of  To  avoid  overflow  in  the  filter  coefficients,  we  assume  that 

the  weighting  of  the  most  significant  bit  assigned  to  the  quantizer  is  greater  than  gk.max,  where 

flfc.ma*  =  (4.3) 

Under  this  condition,  the  stepsize  in  the  ib-th  quantizer  would  be  At  =  Ci  <7fc,fnax2~^*  and  the  mean  square 
value  of  the  quantization  error  is 


=  1/Lj*  ^  |gfc^(n)|^  =  02  glmax^' 


where  ci  and  C2  are  constants  independent  of  k  and  t,  Lg^  is  the  length  of  the  subband  filter  In 

practice,  ci  and  ca  will  depend  on  fl*  ^(n),  but  the  bit  allocation  and  coding  gain  is  insensitive  to  the  variation 
of  these  constants.  To  carry  on  the  analysis,  we  assume  that  they  are  constant.  We  further  assume  that; 

(i)  x(n)  is  WSS  as  assiuned  in  the  previous  section. 

(ii)  The  deterministic  cross-correlation  of  the  quantization  error  approximately  satisfies 


1 

—  gk^(p)gj'^(P  +  m)f!ia^aAk-j)6(m). 
'0» _ «  ** 


p=0 

This  is  of  course  never  exact  because  gl'^(n)  is  FIR. 

(iii)  The  length  Lg  of  <;(n)  is  much  greater  than  that  of  the  analysis  filters.  So  Lg^  »  I'gfnk-  This  is  usually 
the  case  if  the  filter  bank  is  of  low  complexity. 

4.1.2.  The  optimal  bit  allocation  and  the  deterministic  coding  gain 

Consider  Fig.  4.1(a).  The  error  of  the  subband  convolution  output  yi(n),  due  to  quantization  of  g^\n), 
can  be  expressed  as 

M-l 

Qvi («)  =  H  (*fc(») * 9*' («)) (4-6) 

By  using  the  assumptions  in  the  noise  model  and  carrying  out  the  exact  same  procedure  in  Section  3,  we 
find  that  the  optimal  number  of  bits  used  to  quantize  the  subband  filter  p][*^(n)  is 

M-l 

bk  =  b  +  0.5  logj  0*^52, ma*  -  0.5  V'  logj (ff*, .  (4.7) 


Under  this  optimal  bit  allocation,  the  average  output  variance  is 

^Lopt  =  '  \  (4.8) 

In  contrast,  suppose  we  have  convolved  directly  (i.  e.,  without  any  filter  beink).  If  ^(n)  is  quantized  to  b  bits 
and  without  coefficient  overflow,  then  the  output  error  variance  is 

«^irect  =  c  Lg2-^gl^al ,  (4.9) 


where  gr^ax  =  max„  |g(n)|. 

Therefore,  from  (4.8)  and  (4.9),  we  find  that  the  deterministic  coding  gain  of  the  one-level  FB  convolver 
over  the  direct  form  is 


'p,  one 


9 max 


niS'K)’'"*  nr/oMsl,.....) 


l/n*  ■ 


(4.10) 


A  lower  bound  for  the  coding  gain.  In  the  above  derivation,  orthonormality  property  of  the  filter 
bank  is  not  required,  biorthonormality  is  sufficient.  As  there  is  no  strong  relationship  between  gk.max  and 
9max  )  even  for  the  case  of  orthonormal  convolver,  the  deterministic  coding  g^  cannot  be  proved  to  be 
always  greater  than  unity.  The  likelihood  that  the  deterministic  coding  gain  is  less  than  unity  is  very  low.  In 
fact,  in  all  the  examples  we  encountered  in  numerical  experiments,  the  coding  gain  is  quite  large.  However, 
if  the  analysis  and  synthesis  filters  have  unit  energy  (this  condition  indeed  implies  that  the  biorthonormal 
filter  bank  is  orthonormal  [24]),  we  can  obtain  a  (very  pessimistic)  lower  bound  for  the  coding  gain.  R-om 
Appendix  A,  we  have  the  following  very  loose  relationship  between  gk,max  aiid  gmax- 


9k,max  ^  9n 


(4.11) 


where  Lh,,  is  the  length  of  the  filter  Hk{z).  Substituting  (4.11)  into  (4.10),  we  find  that  the  coding  gain  is 
lower  bounded  as 


l/n* 


(4.12) 


Remarks:  We  can  also  define  gki.max  =  niax„  i9fc^(n)|  in  the  noise  model.  Based  on  these  parameters, 
we  can  minimize  the  output  error  variance  by  using  “  periodically  time-varying”  bit  allocation  scheme  (that 
is,  use  bki  instead  of  bk).  Although  this  is  more  general  than  what  have  been  done  above,  the  improvement 
is  negligible  for  the  one-level  FB  convolver.  The  reason  is  that  in  this  convolver,  Sfc^(n)  is  obtained  by 
time-shifting  the  input  g(n),  and  s*  would  not  vary  very  much  with  respect  to  t.  In  fact,  in  all  the 
numerical  experiments  we  carried  out,  we  find  that  all  bki  the  same  for  all  i,  even  if  we  allow  periodically 
time-varying  bit  allocation.  However,  in  the  case  of  the  two-level  FB  convolver,  this  is  not  true.  The  coding 
gain  usually  increases  by  a  large  amount  if  a  periodically  time-varying  bit  allocation  scheme  is  employed. 


4.2.  Low  sensitivity  FIR  filter  structures  using  the  two-level  FB  convolver 
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We  can  implement  FIR  filters  using  the  two-level  FB  convolver  instead  of  the  one-level  FB  convolver. 
This  will  give  a  lower  sensitivity  (i.  e.  ,  provide  a  much  higher  deterministic  coding  gain).  Or  equivalently, 
we  can  afford  to  quantize  the  subband  filters  to  a  much  lower  bit  rate  for  a  fixed  accuracy.  The 

optimal  bit  allocation  and  deterministic  coding  gain  will  be  derived  in  the  following.  Again  for  a  preview  of 
the  advantage  of  the  two-level  FB  convolver  over  the  one-level  FB  convolver,  compare  Fig.  5.3  and  Fig.  5.4. 
The  equivalent  filter  responses  for  both  the  cases  are  comparable  even  though  the  average  number  of  bits 
used  in  the  two-level  FB  convolver  (2  bits)  is  only  half  of  that  used  in  one-level  FB  convolver  (4  bits). 

Consider  Fig.  4.1(b).  Let  bid  be  the  number  of  bits  tised  to  quantize  the  subband  filter  g^\n).  Then 
the  average  bit  rate  6  is  defined  as  in  (3.1).  The  noise  model  assumed  here  is  the  same  as  that  in  Section  4.1 
except  that  (4.4)  is  replaced  with 

E  (4.13) 

n=:0 

where 

5*:t.fTuix=max|5]^*^(n)|.  (4.14) 

n 

4.2.1.  The  optimal  bit  allocation  and  the  deterministic  coding  gain 

The  error  at  the  location  yi(n)  in  Fig.  4.1(b)  can  be  expressed  as  (4.6).  To  carry  on  the  anal}rsis,  we  will 
assume  that  the  filter  bank  {F/(2)}  is  paraunitary.  By  using  the  same  technique  as  in  the  previous  section, 
we  find  that  the  optimal  bit  used  to  quantize  g^H^)  is 

bki  =  b  +  0.51og2  ol^gli,max  "  0-5  E 

3=0 

where 

\/L 

=  n  (^w.max)  =  geometric  mean  of  ffJi.max-  (4-16) 

i=0  ' 

The  average  output  noise  variance  under  optimal  bit  allocation  is 

(4.17) 

ic=0 


Prom  (4.9)  rmd  (4.17),  we  find  that  the  deterministic  coding  gain  of  the  two-level  FB  convolver  over  the 


direct  form  is 


_ J^x _  V  _ Umax _ 


(4.18) 


A  lower  bound  for  the  coding  gain.  Agmn  we  cannot  show  that  the  coding  gmn  is  always  greater 
than  unity.  But  by  exploiting  the  result  from  Appendix  A  (with  /i*(n)  replaced  with  /ifc(n)  ♦  hj(n)),  we  can 
obtain  a  (very  pessimistic)  lower  boimd  similar  to  (4.12)  for  the  coding  gain.  The  lower  bound  is 


Gg,  two  > 


(4.19) 
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where  Lh'  is  the  length  of  the  analysis  filter  assumed  to  be  the  same  for  all  i.  By  taking  the  ratio  of 

(4.18)  to  (4.10),  we  find  that  the  ratio  of  the  deterministic  coding  gain  of  the  two-level  FB  convolver  to  that 
of  the  one-level  FB  convolver  is 


R. 


M-l  „3 

-  n  {^) 


l/n* 


*=0 


(4.20) 


Comparisons  of  results.  Comparing  the  coding  gain  formulas  in  all  the  cases  (G*,one»  G*,two.  Gy,one 
and  Gg,two),  we  find  that  all  of  them  have  the  following  form 


G  = 


(4.21) 


All  of  them  have  a  common  first  factor  which  is  always  greater  than  unity  when  the  filter  bank  is  orthonormal. 
They  differ  only  in  the  second  factor.  All  of  them  can  be  obtained  by  substituting  and  Aj  with  the 
corresponding  parameters.  The  only  difference  is  that  unlike  in  the  case  of  the  statistical  coding  gain  in 
Section  3,  for  the  deterministic  coding  gain  we  cannot  prove  a  result  similar  to  (3.21).  That  is,  we  cannot 
prove  that  is  the  arithmetic  mean  of  gii^maxy  ®ven  if  the  filter  /f,'(r)  is  paraunitary.  So  the  ratio  of 

the  deterministic  coding  gain,  Rg  in  (4.20),  cannot  be  proved  to  be  always  greater  than  one.  Nevertheless, 
in  practice,  we  will  find  that  l3^  is  usually  much  smaller  than  for  a  frequency  selective  filter  g{n).  The 

reason  is  that  under  usual  situations  the  arithmetic  mean  of  gki^max  would  not  differ  much  from  gi^max- 
9ki  max  considerably  with  respect  to  *  if  i;(n)  is  frequency  selective.  Thus,  we  may  expect  that  the 

coding  in  (4.18)  would  be  much  larger  than  that  in  (4.10)  as  we  will  see  in  the  numerical  examples  in  the 
following  section. 

Coding  gain  when  both  input  signal  x(n)  and  filter  ^(n)  are  quantized.  When  quantizers  are 
inserted  in  both  the  subbands  of  x(n)  and  ^(n),  the  coding  gmn  is  not  the  product  of  Gz  and  Gg.  To 
obtain  the  coding  gmn,  we  apply  the  optimal  bit  allocation  formulas  in  (3.14)  and  (4.15)  respectively  to  the 
quantization  of  Xk(n)  and  gl'\n),  and  ignore  the  second  order  effect.  The  coding  gain  is 


„  _  {^qy,opt  }*  "1" 


(4.22) 


where  the  subscript  “i”  is  used  to  denote  the  case  when  only  x(n)  is  quantized,  and  'g”  is  used  to  denote 
the  case  when  only  g(n)  is  quantized.  We  see  that  the  largest  error  term  in  (4.22)  will  dominate  the  coding 
gain. 


5.  NUMERICAL  EXAMPLES 

In  this  section,  only  gk(n)  are  quantized,  but  not  Xk{n).  In  the  presence  of  quantizers  in  the  subbands 
of  g(n),  the  LTI  system  with  impulse  response  p(n)  is  effectively  replaced  with  a  periodically  time  varying 
system  (LPTV)  (see  Section  10.1  of  (3]  for  an  introduction  to  LPTV  sjrstem)  with  period  L  (see  next  section 
for  the  discussion).  To  describe  the  system,  we  have  to  characterize  all  L  transfer  functions  Tjt(z)  as  shown 
in  Fig.  5.1.  In  all  the  following  examples,  we  therefore  show  all  transfer  functions. 
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In  the  first  four  examples,  g{n)  is  an  equiripple  lowpass  filter  with  Lg  =  132.  The  stopband  attenu¬ 
ation  6,  =  —60  dB  and  the  passpand  ripple  size  6p  —  0.010.  The  frequency  responses  of  ^(n)  with  direct 
quantization  to  4  bits  and  without  quantization  are  shown  in  Fig.  5.2,  the  stopband  attenuation  reduces  to 
—17  dB  and  the  passband  ripple  size  increases  to  0.049  after  quantization.  In  these  four  examples,  we  will 
show  the  equivalent  filters  if  we  implement  g{n)  by  using  the  low-sensitivity  structures  (Fig.  4.1(a)  and  (b)). 
For  comparison  of  the  results  in  the  first  four  examples,  we  summary  the  main  features  in  Table  5.1.  In 
the  last  two  examples,  we  will  show  the  deterministic  coding  gain  and  verify  the  theoretical  values  with  the 
experimental  values. 

Example  1.  4  channel  paraunitary  (PU)  filter  bank  (one-level  FB  convolver):  L  =  M  =  A,  and 
6  =  4  bits.  The  4  clumnel  filter  bank  in  Fig.  4.1(a)  is  taken  to  be  a  tree-structured  PU  filter  bank  obtained 
by  using  two-channel  PU  filter  bank  in  a  symmetric  tree.  The  two-channel  PU  system  uses  Filter  8A  in  (25). 
If  we  implement  the  analysis  bank  {Hk{z)}  in  lattice  form,  we  need  only  8  multiplications  per  input  sample. 
The  corresponding  optimal  bit  allocation  is  6o  =  10,  6i  =  5,  62  =  1,  63  =  0  bits.  As  shown  in  Fig.  5.3,  the 
stopband  attenuations  of  all  the  4  filters  Ti(z)  are  more  than  42  dB,  i.  e.  more  than  25  dB  better  than  that 
of  the  direct  quantization.  The  passband  ripple  6p  =  0.013.  The  effect  of  quantization  on  the  ripple  size  is 
negligible. 

Example  2.  4  channel  PU  filter  bank  (two-level  FB  convolver):  L  =  M  =  A,  and  6  =  2  bits. 
Both  the  filter  banks  formed  by  {^*(2)}  and  {Hl{z)}  are  taken  to  be  the  filter  bank  used  in  Example  1. 
The  corresponding  bit  allocation  is  shown  in  Table  5.2.  As  we  would  expect,  6fc<  are  large  for  i  =  0  because 
most  of  the  energy  of  G(z)  is  in  the  first  branch.  As  shown  in  Fig.  5.4,  the  stopband  attenuations  (44  dB) 
are  comparable  to  that  obtained  in  Example  1  but  the  average  bit  rate  6  is  reduced  to  half.  The  passband 
ripple  6p  =  0.015. 

Example  3.  4  and  8  channel  DCT  coders  (one-level  FB  convolver):  6  =  4  bits,  we  use  the  DCT 
filter  bank,  shown  in  Fig.  4.1  in  [2].  In  a  transform  coder  filter  bank,  the  polyphase  matrix  E(z)  of  the 
analysis  filters  is  a  constant  matrix  T.  In  this  example,  two  cases  of  T  are  considered:  (i)  4  x  4  DCT  matrix 
(ii)  8x8  DCT  matrix  as  defined  in  Eq.  (12.157)  (22).  DCT  has  the  advantage  that  the  analysis  filters  have 
linear  phase  and  there  exists  fast  algorithm  for  the  computation  of  DCT.  The  corresponding  bit  allocations 
are  shown  in  Table  5.3.  For  each  case,  we  show  only  one  transfer  function  To(z)  in  Fig.  5.5  for  simplicity. 
We  see  that  for  A/  =  4  ,  the  stopband  attenuation  is  32  dB  and  6p  =  0,022.  For  M  =  8,  the  stopband 
attenuation  is  38  dB  and  6p  =  0.012. 

Example  4-  4  and  8  channel  DCT  coders  (two-level  FB  convolver):  6  =  2  bits.  The  filter  bank 
used  here  is  the  same  as  Example  3.  And  {H'f^{z)}  is  identical  to  {^^^(z)}.  The  optimal  bit  allocation  for 
4x4  DCT  is  shown  in  Table  5.4.  The  corresponding  optimal  bit  allocation  for  8  x  8  DCT  is  shown  in  Table 
5.5.  For  simplicity,  we  show  only  To(2)  in  Fig.  5.6.  The  stopband  attenuations  for  M  =  4  and  Af  =  8  we 
27  dB  and  33  dB  respectively.  The  passband  ripple  size  increases  to  0.035  and  0.017  respectively  for  Af  =  4 
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and  M  =  8. 

Example  5.  Coding  gain  (one-level  FB  convolver):  M  =  4  and  6  =  8  bits.  The  filter  bank  used 
here  is  the  same  as  that  used  in  Example  1.  The  input  signal  x(n)  is  taken  to  be  an  AR(5)  process  with 
autocorrelation  coefiicients  R{k)  obtained  from  Table  2.2  of  [22]  (lowpass  speech  source).  The  first  two 
rows  of  Table  5.6  show  respectively  the  coding  gain  obtained  from  (4.10)  (Gp,one)  and  that  obtmned  from 
experiment  (Gj,  ezpt.one)  for  5  different  filters  g{n)  (Filter  1  is  the  g{n)  used  in  the  previous  4  examples).  In 
most  cases  the  theoretical  value  obtained  from  (4.10)  is  very  close  to  the  experimental  result,  in  spite  of  the 
many  statistical  assmnptions  used. 

Example  6.  Coding  gain  (two-level  FB  convolver):  The  filter  bank  formed  by  {H[{z)}  is  identical 
tc  that  formed  by  {fffc(z)}  and  other  conditions  are  the  same  as  those  in  Example  5.  The  coding  gain 
obtmned  from  (4.18)  (Gj,two)  and  that  obtained  from  experiment  (G,  expt.two)  for  the  same  set  of  5  different 
filters  g{n)  are  shown  in  the  third  and  fourth  rows  of  Table  5.6  respectively.  Again  we  see  that  the  theoretical 
values  are  very  close  to  the  experiment  results.  The  performance  of  the  two-level  FB  convolvers  is  much 
better  (8.7-17.4  dB  or  equivalently  1.5-3  bits  approximately)  than  that  of  one-level  FB  convolvers  for  all  the 
5  cases.  The  ratios  of  the  coding  gain  for  the  two-level  FB  convolver  to  that  of  the  one-level  FB  convolver, 
Rg  (theoretical)  and  Rg^expt  (experimental)  are  shown  in  the  last  two  rows  of  Table  5.6. 

From  the  first  four  examples,  we  notice  that  the  performance  of  the  DCT  coder  is  not  as  good  as  that  of 
the  PU  filter  bank  transformer  in  Example  1  and  2.  The  reason  is  that  the  analysis  filters  of  the  DCl  coder 
have  a  smaller  stopband  attenuation.  The  leakage  from  the  adjacent  band  is  quite  large.  In  the  last  two 
examples,  we  see  that  the  coding  gain  for  the  two-level  FB  convolver  is  much  larger  than  that  of  the  one-level 
FB  convolver  although  we  cannot  prove  theoretically  that  this  is  always  true.  By  using  the  two-level  FB 
convolvers  in  the  convolution,  we  get  a  much  higher  accuracy  at  the  expense  of  the  cost  of  one  filter  bank. 

6.  RELATION  TO  BLOCK  FILTER  AND  ALIASING  EFFECT 

6.1.  Convolvers  in  the  view  of  block  filter 

It  is  well-known  [11],  [12],  [13],  [6],  [Chapter  10,(3]]  that  block  filtering  is  a  technique  to  implement  a 
scalar  filter  G(z)  in  such  a  way  as  to  increase  the  parallelism.  In  this  section,  we  will  explore  the  relationship 
between  the  filter  bank  convolver  and  the  conventional  block  filtering  technique.  It  was  shown  in  [26]  that 
the  nonuniform  system  of  Fig.  1.1  can  be  expanded  as  an  L-channel  uniform  system.  The  M  pedrs  of  filters 
{Hk(z),  Fk{z)}  in  the  nonuniform  system  are  replaced  by  the  L  pmrs  of  filters,  say  {H’^{z),  Fl^{z)},  in  the 
uniform  system.  We  will  discuss  the  uniform  case  only,  as  the  nonuniform  problem  can  be  translated  to 
uniform  case. 

6.1.1.  Conventional  block  filtering 

Given  any  scalar  filter  G(z),  we  can  implement  it  by  using  block  filtering  technique  as  shown  in 


19 


Fig.  6.1(a).  The  matrix  G(z)  in  Fig.  6.1(a)  is  a  pseudocirculant  matrix  and  it  can  be  written  as: 


/  Go(z) 

Gi(z) 

Gziz) 

...  Gjif_i(z)\ 

z“^Gm-i(«) 

Go(z) 

Gi(z) 

. . .  Gm-2{z) 

G(z)  = 

Z-^Gm-2(z) 

z~^Gm-i{z) 

Go{z) 

. . .  Gm-3(*) 

V  z-iGi(z) 

Z~^G2(z) 

z-^Gsiz) 

Go(2)  / 

(6.1) 


where  Gi{z)  is  the  tth  polyphase  component  of  the  scalar  filter  G(z).  In  fact,  the  multirate  system  in 
Fig.  6.1(a)  is  a  linear  time-invariant  (LTI)  system  if  and  only  if  G(z)  is  a  pseudocirculant  matrix  [27].  R-om 
(6.1),  it  is  clear  that  we  have  the  following  relationship  between  [G(z)]ifc,  the  elements  of  the  matrix  G(z) 
and  the  filter  G{z): 

z-‘G(z)=^z-*[G(z")].,.  (6.2) 

<c=0 

Moreover,  it  can  be  shown  [3]  that  the  matrix  G(z)  is  paraunitary  if  and  only  if  the  filter  G{z)  is  an  allpass 
filter.  When  G(z)  is  FIR,  this  is  impossible  unless  G(z)  is  a  delay. 


6.1.2.  Relation  of  one-level  FB  convolver  to  conventional  block  filtering 

In  the  case  of  one-level  FB  convolver  with  uniform  decimation  ratios,  the  ith  Type  2  pol3rphase  compo¬ 
nent  of  x(n)  *  g(n)  can  be  written  as  (2.1)  with  L=^  M  and  all  p*  =  1.  We  reproduce  the  eqtiation  here  for 
convenience; 

M-l 

y,(z)  =  (z-‘X(z)G(z))  =  E  Xfc(z)Gl'>(z),  0  <  t  <  M  -  1,  (6.3) 

fc=0 

where  the  subband  signal  G^^\z)  is  the  fcth  GPP  component  of  z”*G(z)  with  respect  to  {ffj(z)}  as  defined 
in  Fig.  1.1(b).  By  writing  (6.3)  for  all  values  of  t,  we  obtsun  the  matrix  equation; 


/  nW 

Yi{z) 

\Fa/-i(z)> 


=  Go„e(z)x(2). 


(6.4) 


where  the  column  vector  x(z)  =  [Xo(z)  Xi(z)  . . .  Xm-i(2)]^  and  the  matrix  Gone(2)  is  defined  as; 


Gone(^)  — 


/  gI,%)  Gi%)  ...  GlSU(z)\ 

G^%)  Gi%)  ...  Gli)_i(z) 

Gi*^-%)  ...  Gi^-%)^ 


(6.5) 


By  the  definition  of  Type  2  polyphase  representation,  the  output  of  the  convolution  y(n)  can  be  written 
compactly  as: 


y(z)  =  e(z) 


yi(z*^) 


=  e(z)Go„e(z*^)x(z*^), 


(6.6) 
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where  e{z)  is  the  row  vector  [l  z  ...  R-om  (6.6),  we  immediately  get  the  implementation  in 

Fig.  6.1(b),  by  using  the  fact  that  Xkiz)  =  [X{z)Hk(z)\^^^. 

Comparison  betweei  one-level  FB  convolver  and  conventional  block  filtering.  Comparing 
Fig.  6.1(a)  and  (b),  we  discover  that  the  one-level  FB  convolver  is  a  generalized  version  of  block  filtering. 
Instead  of  decomposing  x(n)  and  g{n)  into  their  conventional  polyphase  components  as  we  did  in  Section 
6.1.1,  we  decompose  x(n)  and  g{n)  into  their  GPP  components  respectively  with  respect  to  two  separate 
sets  of  polyphase  basis,  namely  {jyj(2)}  and  {Fj(2)}.  The  delay  chain  before  the  block  filter  is  replaced  by 
a  more  general  analysis  bank  with  filters  {Hfc(z)}.  Therefore,  we  can  view  the  convolver  as  a  generalized 
block  filtering  technique,  which  provides  not  only  the  advantage  of  parallelism,  but  also  the  advantage  of 
coding  gain  when  implemented  in  finite  percision.  Of  course,  the  coding  g^  is  obtained  at  the  expense  of 
the  cost  of  one  filter  bank.  This  generalized  block  filtering  technique  provides  a  good  tradeoff  between  the 
coding  gain  and  the  complexity.  This  is  the  advantage  that  the  conventional  block  filtering  technique  does 
not  have.  By  using  GPP  representation,  a  relationship  similar  to  (6.2)  between  [Gone('2)]jj,  and  G{z)  can 
be  interpreted  nicely  as: 

M-l 

z-'Giz)  =  Yi  [Go„.(^")],fcif*(z).  (6.7) 

fc=0 

It  also  can  be  proved  (see  Appendix  B)  that  the  matrix  Gone(r)  is  paraunitary  if  and  only  if  the  filter  G{z) 
is  an  allpass  function,  provided  that  the  set  of  filters  {lffc(2)}  is  paraunitary. 

6.1.3.  Relation  of  two-level  FB  convolver  to  conventional  block  filtering 

For  two-level  FB  convolver  with  uniform  decimation  ratios,  the  ith  GPP  component  of  x(n)  ♦  g(n)  with 
respect  to  the  pol}q)hase  basis  {^/(z)}  is; 

M-l 

Yiiz)  =  Y  Xkiz)G't:\z),  0  <  i  <  M  -  1,  (6.8) 

fc=0 

where  the  subband  signals  G^^\z)  are  the  fcth  GPP  components  of  if((z)G(z)  with  lespect  to  {/fi(z)}  as 
defined  in  Fig.  2.1.  By  writing  (6.8)  for  all  values  of  k,  we  get  the  equations  similar  to  (6.4)  and  (6.5),  except 
that  the  matrix  Gone(^)  is  replaced  by  G^(z),  where [Gtwo(z)]^j  =  Gj^(z).  By  defining  the  row  vector 
f'(z)=  [n(z)  Fi(z)  ...  F'^_  ,1(2)],  the  output  of  the  convolution  y(n)  can  be  reconstructed  from  the 
GPP  components  yi(z)  (as  defined  in  (6.8))  as: 

Y(z)  =  Y  =  f'(z)G„™(z")x(2*'),  (6.9) 

k=0 

where  the  colunm  vector  x(z)  is  as  defined  in  previous  section.  FVom  (6.9),  we  get  the  implementation  of 
the  two-level  FB  convolver  as  in  Fig.  6.1(c). 

Comparison  between  one-  and  two-level  FB  convolver  in  the  light  of  block  filtering.  Compar¬ 
ing  Fig.  6.1(b)  and  (c),  clearly  the  two-level  FB  convolver  is  a  generalized  version  of  one-level  FB  convolver. 
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In  the  two-level  FB  convolver,  the  “advance  chain”  in  the  one-level  FB  convolver  after  the  block  filter  is 
replaced  by  a  more  general  synthesis  bank  with  filters  {F^(2)}.  Notice  that  the  sets  of  filters  {Hic(z)}  and 
{F/(z)}  can  come  from  two  different  biorthonormal  systems.  The  relationship  between  [Gtwo(2)]jj^  and  G(z) 
can  be  written  as: 

M-l 

mz)Giz)  =  x;  [G»,^(z")]  (6.10) 

k=0 

Similarly,  we  can  prove  (Appendix  B)  that  the  matrix  Gtwo(2)  is  paraunitary  if  and  only  if  the  filter  G(z)  is 
an  allpass  function,  provided  that  the  sets  of  filters  {Njt(z)}  and  are  paraunitary. 

Remarks:  The  adaptive  structure  in  Fig.  2  of  (14]  is  a  simplified  version  of  the  two-level  FB  convolver 
in  Fig.  6.1(c)  (with  the  second  set  of  filter  Fj((z)  replaced  with  Ffc(z)). 


6.2.  Aliasing  effects  and  the  equivalent  LPTV  filter  in  the  presence  of  quan¬ 
tizers 


In  the  presence  of  quantizers  in  the  subband  of  gin),  the  equivalent  ^stem  is  not  a  linear  time  invariant 
(LTI)  system  anymore.  We  will  discuss  the  aliasing  effect  and  the  relation  between  the  subband  convolver 
and  a  linear  periodically  time  varying  (LPTV)  system. 

Let  C?fc^(z)  be  the  z  transform  of  g*^(n),  where  g^^(n)  is  defined  in  (4.2).  Define  the  matrix  Q(z) 


(6.11) 


Let  Gone('Z)  be  the  quantized  version  of  Gone(i!)-  Then  Gone{«)  =  Gone(^)  +  Q(i:)-  The  system  in  Fig.  6.1(b) 
can  be  drawn  equivalently  as  that  in  Fig.  6.2(a).  The  upper  path  gives  the  desired  output  and  the  lower 
path  represents  the  error.  By  using  the  polyphase  representation.  Fig.  6.2(a)  can  be  redrawn  as  Fig.  6.1(b) 
where 

P(z)  =  Q(z)E(z),  (6.12) 


<?i"^(^)  ... 

Q(z)  = 

Q^o\^) 

<?l‘)(z)  ... 

and  E(z)  is  the  polyphase  matrix  of  the  analysis  filters  Hk{z).  FYom  Fig  6.2,  we  see  that  the  lower  path  is 
an  LPTV  filter  and  it  is  an  LTI  filter  if  and  only  if  the  matrix  P  is  psuedocirculant  ([3],  Section  10.1).  For 
the  case  of  the  two-level  FB  convolver  as  in  Fig.  6.1(c),  the  similar  result  holds  except  that  the  matrix  P(z) 
is  replaced  by 

P(z)  =  R'(z)Q(z)E(z),  (6.13) 


where  R'(z)  is  the  Type  2  poljrphase  matrix  of  the  synthesis  filters  F/(z). 

Let  d(z)  =  [  £io(z)  di(z)  ...  dAr_i(z)  ]'*’  =  P(z*^)e(z),  where  e(z)  =  (1  z~^  ...  and  let 

Ti(z)  =  z“*G(z)  -I-  di(z).  Then  the  system  in  Fig.  6.2  can  be  redrawn  as  Fig.  5.1.  The  aliasing  components 
j4j(z)  (see  Eq.  (5.4.7)  of  [3])  can  be  expressed  as; 


M-l 


^  4VJ  a 

Ai{z)  =  for  1  <  1  <  M  -  1 


(6.14) 


fc=0 
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and 


j  M-l 

Ao(2)  =  G(z)  +  5;  dfc(z).  (6.15) 

k=0 

G(z)  is  the  desired  response,  represents  the  distortion  and  for  1  <  t  <  Af  —  1,  Ai(z)  are  the 

tdiasing  components.  The  error  due  to  the  aliasing  and  distortion  can  be  written  as 

s" = E 

$=i 

M-l  ,  M-l  2 

=  E  |jff  E 

»=0  fc=0 

^  aH  E*  E'  (6.16) 

■*  t=o  fc=0 

The  magnitude  respionses  of  die(z)  for  Example  1  are  shown  in  Fig.  6.3.  All  the  magnitude  responses  are 
imder  40  dB  even  though  the  coefficients  are  quantized  to  an  average  bit  rate  of  4  bits  only. 

6.3.  Subband  implementation  of  LPTV  filters 

From  the  earlier  discussion  in  this  section,  it  is  natural  to  ask  if  the  subband  convolver  can  be  modified 
to  implement  an  LPTV  filter.  In  the  following  we  wiU  show  that  the  answer  is  in  the  afiinnative.  The 
implemenation  leads  to  a  low  sensitivity  structure  for  LPTV  filters. 

Given  an  LPTV  filter  with  period  L,  we  can  characterize  the  filter  by  a  set  of  L  transfer  functions 
{Ti(z)}  as  shown  in  Fig.  5.1.  Notice  from  the  figure  that  the  tth  polyphase  component  pi(n)  of  the  output 
of  the  LPTV  filter  is  completely  determined  by  the  transfer  function  r<(z).  By  Theorem  2.1,  yi(Ti)  can  be 
obtained  as; 

M-l 

y,(n)  =  (i(n)  •  =  E 

where  ti(n)  is  the  impulse  response  of  Ti(z),  Xfc(n)  are  defined  in  Fig.  1.1(a),  and  tik(n)  are  the  subband 
signals  obtained  by  replacing  ff(n  -  i)  in  Fig.  1.1(b)  with  tj(n).  The  periodically  time  varying  bit  allocation 
can  be  employed  to  achieve  a  low  sensitivity  structure  for  LPTV  filters. 

7.  LOW  SENSITIVITY  STRUCTURES  FOR  UR  FILTERS 

If  we  consider  the  HR  filtering  problem  as  two  FIR  filtering  problems  (one  in  the  forward  path  and  one 
in  the  feedback  path),  then  the  low  sensitivity  structure  for  FIR  filters  can  be  applied  to  obtained  a  low 
sensitivity  structure  for  HR  filters.  Though  the  application  is  straight  forward,  several  issues  like  stability 
and  causality  must  be  taken  care.  Any  filter  with  rational  transfer  function  can  be  considered  as  a  cascade 
of  an  all-zero  filter  and  an  all-pole  filter.  In  Section  4,  we  have  already  considered  the  structure  for  all-zero 
filters.  Thus  we  will  study  the  low  sensitivity  structure  only  for  an  all-pole  filter.  Let 

^  l-h6(l)z-'  +  ...  +  b(N)z-^' 
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Then  the  output  of  the  convolution  z(n)  *  g(n)  can  be  written  as 

N 

v(«)  =  -  51  ~  + *(”)•  c^-^) 

fcsl 

The  summation  at  the  right  hand  sight  can  be  considered  as  the  convolution  of  b(n)  and  y(n).  This  gives  the 
implementation  in  Fig.  7.1.  If  the  spectrum  of  x(n)  is  known,  then  so  is  that  of  y{n).  The  coefficients  6(n) 
can  be  quantized  in  the  subbands  according  to  the  energy  distribution  of  y(n)  and  6(n).  Thus  the  output 
error  due  to  quantization  can  be  minimized  by  optimal  bit  allocation.  However,  the  low  sensitivity  structure 
for  HR  filters  is  not  as  useful  as  that  for  FIR  filters  because  of  the  following  reasons: 

Stability.  From  Section  6,  we  know  that  the  equivalent  system  with  subband  quantization  is  an  LPTV 
system.  With  an  LPTV  system  in  a  feedback  loop  as  in  Fig.  7.1,  the  analysis  of  stability  of  the  overall  filter 
is  very  difficult  [28].  Even  though  the  original  filter  g{n)  is  stable,  we  cannot  ensure  the  stability  of  the 
resultant  filter  after  quantization. 

Causality.  Assume  that  Hk(z)  and  Fk(z)  are  causal  filters.  If  the  system  in  Fig.  1.1  is  perfect  recon¬ 
struction  system,  then  the  M-th  channel  filter  bank  will  introduce  a  delay  of  at  least  M  —  1  samples  [8]. 
That  means  that  the  subband  convolver  will  introduce  some  delay,  say  D.  At  the  instant  of  the  computation 
of  i/(n),  the  output  of  the  convolver  in  the  feedback  path  is  y{n  —  D)*  b{n  —  D).  At  the  time  instant  n,  to 
compute  the  summation  in  the  right  hand  side  of  (7.2),  we  need  y(n  -f-  i)  for  0  <  i  <  D,  which  is  impossible. 
To  avoid  the  noncausality,  we  can  use  (7.2)  repeatedly  to  get 

N+D  D 

yin)  =  -  X]  “  *)  +  51  d{k)xin  -  k).  (7.3) 

fc=D+l  fc=0 

However,  D  more  multipliers  (d(k)  in  the  second  summation)  are  required  in  the  implementation.  If  the 
delay  D  is  long,  then  this  computational  overhead  is  large. 

Complexity.  As  we  mentioned  earlier,  for  the  subband  convolver  to  be  useful,  the  FIR  filter  must  have 
a  long  impulse  response.  But  for  the  HR  filter,  the  filter  seldom  has  an  order  N  greater  than  10.  In  this 
case,  the  complexity  of  the  filter  bank  is  comparable  to  (or  even  higher  than)  that  of  the  filter  g{n). 

Frequency  selectivity.  Let  B{z)  =  6(1)2“*  +  b{2)z~^  -I- ...  -I-  b{N)z~^ .  The  deterministic  coding  of  the 
subband  convolver  is  high  when  the  FIR  filter  B{z)  is  frequency  selective.  But  since  B{z)  is  only  a  part  of 
the  denominator  of  an  HR  filter,  the  energy  of  B(z)  is  distributed  all  over  the  frequency  domain,  even  when 
the  filter  g(n)  is  a  frequency  selective  filter. 

8.  CONCLUDING  REMARKS 

8.1.  IFIR  filter  as  a  special  case  of  subband  convolver 

IFIR  filters  were  introduced  in  [15]  to  design  narrowband  filters.  In  lowpass  case,  if  the  stopband  edge 
is  smaller  than  tt/M,  then  G(z)  can  be  approximated  by  a  cascade  of  two  filters  as: 

G{z)  «  G<°>(2")/(2),  (8.1) 
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where  /(r)  is  a  low  cost  filter.  The  number  of  coefficients  in  is  roughly  equal  to  1/M  of  that  in  G(z). 

Fig.  8.1(a)  shows  the  implementation  of  an  IFIR  filter. 

From  Fig.  1.1(b),  G(z)  can  be  decomposed  into  its  GPP  components  as 

M-l 

G(z)  =  52  (8.2) 

*=o 

The  decomposition  is  exact.  Fig.  8.1(b)  shows  the  implementaion.  If  G(z)  has  passband  smaller  than 
tt/M,  then  only  in  (8.2)  has  significant  energy.  By  dropping  all  the  other  unimportant  channels  in 

Fig.  8.1(b)  corresponding  to  G^°^(z)  (fc  =  1,  2,  . . . ,  M  —  1),  Fig.  8.1(b)  reduces  to  Fig.  8.1(a)  (with  ffo(z) 
and  Fo(z)  regarded  as  J(z)  and  J(z)  respectively).  Therefore,  more  generally,  if  G(z)  is  a  multiband  filter, 
the  subband  convolver  can  be  used  to  approximate  G(z)  by  retaining  the  channels  which  contain  most  of 
the  energy. 

8.2.  Conclusions  and  open  problems 

In  this  paper,  we  have  generalized  the  subband  convolution  theorem  in  [2].  We  have  derived  the  coding 
gain  for  the  generalized  convolver,  and  it  was  proved  that  this  coding  gain  is  always  greater  than  that  of  the 
one-level  FB  convolver  in  [2].  We  also  imified  the  subband  convolvers,  GPP  representation,  block  filtering, 
LPTV  filters,  and  IFIR  filters  under  one  framework.  This  framework  provides  us  a  better  understanding 
of  the  subband  convolvers.  As  an  application  of  the  convolution  theorem,  a  low  sensitivity  structure  for 
FIR  filters  is  proposed.  We  have  defined  the  deterministic  coding  gain  of  the  low  sensitivity  structure  and 
demonstrated  that  the  coding  gain  is  high.  Even  when  the  filter  coefficients  are  quantized  to  a  very  low  bit 
rate,  we  can  get  filters  of  small  passband  ripple  and  large  stopband  attenuation.  However,  the  linear  phase 
property  of  the  filter  g(n)  is  generally  not  preserved  when  we  implement  the  filter  in  the  low  sensitivity 
structure.  How  to  exploit  the  symmetry  (or  some  other  properties  like  Mth-band  property  and  etc)  of  the 
filter  to  save  computation  is  still  an  open  problem.  Another  important  issue  which  is  not  being  addressed  in 
this  paper  is  how  to  design  an  optimal  filter  bank  to  maximize  the  convolutional  coding  gain.  Even  for  the 
case  of  traditional  transform  coder,  the  solution  is  unknown. 
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Appendix  A.  Proof  of  (4.11) 

First,  we  will  prove  a  fact  about  vector  norms  inequality.  This  will  be  used  to  derive  (4.11). 

Fact  B.l.  Let  v  =  (uq  ui  ...  and  let  ||  •  Hi  and  ||  •  II2  denote  l-norm  and  2-nonn  respectively. 

Then 

II  V  ||i<  y/N  II  V  II2  (^.1) 


Proof.  Let  1  =  [1  1  ...  l]"^  and  u  =  (|uol  l^il  ...  Iuat-iI)^.  Then  we  have 

II V  111  =  5^  k|  = 

t=0 

<11 1 II2II  u  lUHl  1 II2II V  Il2=  Viv  II V 1I2, 

using  Cauchy-Schwarz  inequality. 

By  definition,  we  have 


(A.2) 

VVV 


9k.max  =  I5*  ^(n)l  =  |{p(n  -i)*  | 

=  max  |5(n)  ♦  h*(n)| 

fk 

<  9max  ^  l^fc(^)l 
n=0 

The  third  equality  follows  from  the  fact  that  [g{n  —  i)  *  is  one  of  the  polyphase  components  of 

g{n)  *  /ifc(n).  The  last  inequality  follows  directly  from  triangular  inequality.  Applying  Fact  B.l  and  the  fact 
that  /ifc(n)  has  unit  energy  (2-norm  is  unity),  (4.11)  follows  immediately. 


Appendix  B.  Proof  of  some  facts  in  block  filtering 

Lemma  B.l.  One-level  FB  convolver.  Suppose  that  the  set  of  filters  {/f*(z)}  is  paraunitary.  Then 
the  matrix  Gone(2)  defined  in  Fig.  6.1(b)  is  paraimitary  if  and  only  if  the  filter  (7(z)  is  an  allpass  function. 
0 


Proof  By  writing  (6.7)  for  all  values  of  i  =  0,  1,  . . . ,  M  -  1,  we  have  the  following  matrix  equation; 

=  Go„e(z*')E(z*^)e(2),  (B.l) 


/  G(z)  \ 

z-iG(z) 

/  Ho{z)  \ 
=  Go„,(z*^)j 

\z-W+iG(z)> 

\Bm1i(z)/ 

where  the  matrix  E(z}  is  the  polyphase  matrix  of  the  filters  {/f*(z)}  and  e(z)  =  [l  z~^  . . . 
Substituting  z  with  zW~*  for  i  =  0,  1,  . . . ,  M  —  I  into  the  above  equation,  we  get 


A(z)W*g(2)  =  G„„.(z")E(z")A(z)W,  (B.2) 

where  A(z)  is  the  diagonal  matrix  dia9[l  z~'  ...  z'*^'*'*],  ♦g(^)  =  G(zW)  ...  G(zW*^~*)] 

and  W  is  the  M  x  M  DFT  matrix  with  [W]j^.  =  IF*’.  Since  A(z),  W  and  E(z)  are  paraunitary  matrices, 
Gone(2)  is  paraunitary  if  and  only  if  ♦0(2)  is.  The  proof  is  complete.  VVV 
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Lemma  B.2.  Two-level  FB  convolver.  SuppM>se  that  the  sets  of  filters  {Hfc(z)}  and  {Hj^(z)}  are 
paraunitary.  Then  the  matrix  Gtwo('*)  defined  in  Section  6.1.3  (Fig.  6.1(c))  is  paraunitary  if  and  only  if  the 
filter  G(z)  is  an  allpass  fimction.  0 

Proof.  The  proof  is  similar  to  that  of  Lemma  B.l.  By  using  (6.10)  and  following  the  procedure  in  the 
proof  above,  the  lemma  follows.  VV  V 
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Fig.  2.3.  A  pictorial  proof  of  Theorem  2.1, 
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Fig.  3.1.  Relationship  between  the  subband  signals 

of  the  one-level  and  two-level  FB  convolvers. 
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Fig.  4.1.  The  low  sensitivity  structures  for  FIR  filters, 

(a)  with  one-level  filter  bank  convolver, 

(b)  with  two-level  filter  bank  convolver. 
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Fig.  5.2.  Magnitude  response  of  g(n)  with 
direct  quantization  to  4  bits,  and 
without  quantization. 
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Fig.  5.3.  Example  1.  Magnitude  response  of  g(n),  with 

subband  quantization  to  4  bits  by 
using  one-level  FB  convolver. 
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Fig.  5.4.  Example  2.  Magnitude  response  of  g(n),  with 

subband  quantization  to  2  bits  by 
using  two-level  FB  convolver. 
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Fig.  5.5.  Example  3.  Magnitude  response  of  g(n),  with 

subband  quantization  to  4  bits  by 
using  one-level  FB  convolver. 
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Fig.  5.6.  Example  4.  Magnitude  response  of  g{n),  with 

subband  quantization  to  2  bits  by 
using  two-level  FB  convolver. 
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Fig.  7.1.  A  low  sensitivity  structure 
for  an  all-pole  filter. 


Fig.  8.1.  Relationship  between  convolver  and  IFIR  filter, 

(a)  implementation  of  IFIR  filter, 

(b)  implementation  of  convolver. 
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Table  5.2.  Example  2.  The  number  of  bits  bki  allocated  to 
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Table  5.5.  Example  4(ii).  The  number  of  bits  6^*  allocated  to 
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